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UX concept development 
addressing how graphical user 
interfaces can be translated 
into tactile user interfaces 
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about 


Dot Incorporation is a South Korean 

i startup producing innovative assistive 
technology for the blind such as braille 
smart watches, tactile braille displays, 
and accessible information kiosks. 


Dot Pad is the first smart tactile 
graphics display for the visually 
impaired that enables the user to 


access visual content such as 


handwriting, graphs, equations, 


_ kia | photos, documents, sketches and art in 


d real time via 2400 tactile braille pins 
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My relationship with Dot Inc began when | was 


researching an idea for a tactile smart watch that | had. 
| came across Dot's Dot Watch and reached out, asking 
if they were open to a collaboration. 


| began a 10 month internship at Dot Inc, over the 


course of which | was responsible for diverse initiatives: 
+ design research (see emoji case study) . > kadre Sor uidor 
* market research in Japan, Switzerland, EU - k ; 
n ap ; heid -> Derd 
interviews, academic research, and field research A 


* product development - concept development 
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task 


To ensure Dot's tactile displays integrate seamlessly 


+ Kaiser Per mar 
G 
` 


with iOS and macOS devices, we engaged in a 
collaborative effort with Apple Inc. 
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This involved creating user experience (UX) concepts 
and developing an API that enables compatibility 
with Apple's VoiceOver, the primary assistive 
technology used by visually impaired users today. 


team 
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A 3-day workshop was held in Cupertino with ~ f maia i pam i y 
Apple's VoiceOver Team and QA testers. The team , z i - = 
consisted of co-founders Ki Kwang Sung and Eric Ju 
Yoon Kim (far left, middle right), Lead Engineer 
Giyeon Hwang (far right), and me as the design 


researcher. 


My role during the workshop was to create visuals 
and pitch decks (eg for presentation to Apple 
marketing team) and present my case study and 
findings about tactile graphics (see next page). 
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emoji 


Emojis were used as a case study for The emoji were ordered by usage and processed 
how and whether images should be into into 32x32 pixel representation using bash 
processed into tactile graphics. scripting with python. Most of these then had to 


be manually refined in Photoshop. 
Past studies had suggested that the 


ability to understand simple visual The design process led to questions such as 
representations of facial expressions is * which symbols provide the most value and 
innate in humans and not strictly how do we measure this? 

learned, such that tactile emojis could * how do we deal with images that are too 
indeed enhance the writing’s meaning visually complex for single color 32x32 pixels? 
and emotional depth. + is there a responsibility to convey the semantic 


meaning and cultural usage of an emoji or 
symbol, rather than their literal meaning? 


Interacliles 


personal project 
2023-present 


a tactile interface to create 
visuals across distances 


idea 


Developing an interactive grid of buttons that light up and 
change colors when pressed, designed to communicate, 
connect, and create art across distances. 


Each grid is connected via the internet to a corresponding 
grid, allowing users to share visual messages in real-time. 


This project explores the fusion of technology and 
creativity, aiming to understand how we interact with 
digital interfaces on a personal and communal level. 


inspiration 


* The reddit project r/place, a digital online canvas 
allowing the entire online community to collectively 
create pixel art 

* Valentin Ruhry’s and Simone Giertz’s grids of 
illuminated switches 


* “The Everbright”, an installation seen at the San Jose 
Science Museum in 2021 


use Cases 
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few to few 


one to one 


one to many many to many 


1. Public Art Installations: A single 1. Personalized Communication 1. Presence Indicator: individuals in 1. Collaborative Art Projects: users 


different locations can indicate 


user (or a few) control a large, 
public display, creating evolving 
art for viewers 

. Interactive Architecture: 
buildings with facades or 
billboards that the public can 
interact with, changing their 
appearance 


Tool: for intimate, coded 
messages within small groups 
or for eg. long distance 
relationships 


. Educational Tool: Teach basic 


concepts of cause and effect, 
colors, and simple coordination 
skills 


their presence or availability 


2. Mood Communicator: Users can 


express their mood or feelings 
by choosing colors and 
brightness, providing a non- 
verbal form of communication 


work together to create a large- 
scale digital mosaic 


2. “Portal” between two Cities: large 


installations in public squares 
for shared art and messages 
between cities, highlighting 
diversity and unity 
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about 


Participated in Europe's biggest Hackathon 
in Zurich, developing "Remy," a voice- 
assisted cooking app focused on 
sustainability and ease of use. 


Step 1: Start boiling the 
water for the pasta. 
You'll need 1 liter of 


Inspired by Disney Pixar's famous Ratatouille 
character, Remy is an Al powered voice 
assistant for the kitchen. The user can simply 
tell Remy what they're cooking and Remy will 
interactively talk the user through every step 
of the recipe, allowing a hand-free 
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role 


We joined the hackathon as a team of full-stack developers, ML 
researchers, and software architects. | was responsible for the 
following: 


Branding: Developed the app's identity and logo 


UX Design: Implemented a user-friendly interface inspired by 
Spotify's lyrics feature. Selected a color palette that enhances 
appetite while ensuring ease of use from a distance 


Product Management: Coordinated team efforts to align with 
hackathon deadlines and product vision and objectives 


Storytelling and pitch: Co-wrote the product presentation video 
and pitch, produced presentation video 


Good evening, chef 


Today’s special: 


Spaghetti Carbonara 


Default (Remy) 
® Authentic 


Gordon Ramsay 
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| found the most effective habit tracking tools to be visual 


The idea for GlowGrid was born out of the long and anxious hours of 
reminders that would also show me my progress so far. | started 


the COVID-19 lockdown. | was stranded in a tiny studio apartment in 


a Tokyo suburb, having traveled there for an exchange semester but off with posters and later progressed to rainbow scratch paper. | 


now too scared to leave. Not knowing when or if this lockdown would found myself craving that small reward of scratching off another 
day, and noticing a gap in my progress was just painful enough 


that | would try to prevent it. 


end but determined to not go insane, | committed myself to a series 
of new habits (mostly learning japanese, outdoor exercise). 


prototyping 


Even after lockdown ended, | found 
myself still using this method to track my 
habits (now reading books, meditating). | 
came across Simone Giertz’s Everyday 
Calendar, which inspired me to build a 
more tangible and reusable version of this 
habit tracking system. 


The Everyday Calendar uses capacitive 
touch pads that light up when touched. 
Preferring the idea of a more tactile 
experience, my first prototype consisted 
of an acrylic frame with an array of 31 
illuminated neon rocker switches - one 
switch for each day. 


Series units of version 2 
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The first iteration of GlowGrid. Laser cut acrylic frame with steel spacers, Photoshop mockup of a larger version of GlowGrid 
200V neon rocker switches, crimped copper wires. 


The next version of GlowGrid aims to be much larger than 31 switches - 
hopefully hundreds or thousands. Date labels will be omitted, the aim 
shifted towards a broader view of achievement: recognizing that progress 
isn't always linear. The illuminated switches should appear like pixels, 
capturing the essence that every small effort contributes to the bigger 
picture. 


